3 Aug, 2006
The New LSAT Score Reporting Policy
A while back, Professor Paul Caron of TaxProf Blog reported the new policy regarding law schools' reporting of LSAT scores to the ABA. Whereas the ABA previously required that law schools report the average LSAT score of an applicant, the ABA now allows the schools to report the highest score of an applicant.
Some are touting this as a wonderful move. Accepted Admissions Almanac gushes, "I also agree with Daniel Solove of Concuring Opinions that this would be a "terrific policy change." I'm not so sure...
Some Thoughts
To me it's a clear rich get richer sort of deal. Because of rankings, schools are going to report the highest score of an applicant. While law schools may consider any lower test scores during the
admissions decision, schools can certainly disregard lower scores with
little consequence to the school itself. Therefore, a pretty big incentive exists for an applicant to take the exam three times and hope for a high score.
I can see a situation in which an incoming student with plenty of money and time to spare who is scoring, say, in the 150's on practice LSAT exams taking the exam three times and scoring, for example, 150, 155, and a outlier 170. Explain to me again how reporting, in this case, the 170 or any other possible outlier
high score, is less "arbitrary" than the previous averaging policy? The end result is that test takers with the time and money to spend on retaking the test are at a huge advantage over those who lack the time or money retake the test.
Who else gets richer?
Clear incentives to take the LSAT the max amount of times?...The LSAC, administrators of the LSAT, must be thrilled. LSAT preparation companies, who are likely to sell more books and prep courses also must love this.
Protection Against "Bad Days"?
I realize this new policy was put in place to avoid the penalty for those who
have a "bad test day." But I'm not sure why it's better acknowledge those in the opposite extreme, the fluke test. But let's look at what the previous policy meant for students' decisions to retake the LSAT.
Under the previous policy, if the applicant scored below what she believed to be her abilities (and test takers know this as much as they take practice tests), it was worth the time and effort to retake the LSAT because there would likely be an improvement. And if the first score was truly a bad day score, the applicant could take the LSAT two more times to get that average up. Additionally (and most importantly), under the previous policy if an applicant scored at or above what the applicant believed to be indicative of his/her abilities there was a disincentive to retake the test because a lower score would hurt the applicant.
The result with the old policy was that applicants decided whether to retake the LSAT based at least somewhat
on their abilities. If an applicant scored according to what he believed was his abilities or higher, the applicant was more likely to keep that score because he had to consider the fact that a lower score would hurt him/her. So scores probably better reflected the student's abilities.
With the new policy, there is little reason not to take LSAT repeatedly no matter what, even if an applicant scores exactly what she thinks she is capable of. The result is an increased likelihood of a fluke high score on one of the three tests, thereby increasing the chance an applicant will be judged on that higher score.
As much as the previous policy may have hurt test takers' bad days, at least the bad days could be somewhat mitigated with the averaging of the scores. Not to mention, students who were hurt because of a bad LSAT day and had to attend a lesser school as a result could transfer to a better school if the higher scores were truly indicative of their abilities in law school. On the contrary, the new policy of giving more credence to fluke high scores is worse than acknowledging bad day scores because:
1) Even if the test taker knows a certain score is representative of his abilities (or even a overly representative) there is little reason not to play again and hope for an even bigger score.
2) Fluke score students could end up at a school at which they may not be able to cut it and possibly flunk out. Whereas bad test day students may end up at a school for which they are overqualified (in which case the student has a shot at transferring up and out) and bad day scores can mitigate by retaking and averaging out.
3) The people who can't afford to take
the test more than once are at a distinct disadvantage because they
don't have that extra shot at at the unlikely high score whereas a student who can afford it can retake and further prepare for the LSAT regardless of how indicative the first test was of his/her abilities.
Advice for LSAT takers
No matter what you are scoring in practice or scored previously, unless you know your score will get you accepted at a top school of your choice, take the LSAT the max amount of times and hope to hit the lottery one time if you can afford to.
Unless someone has an argument against this that I am missing, I don't see the disadvantage. Schools are now less likely to be deterred by low LSAT scores. If you don't have the money or time to take the LSAT repeatedly, then I guess you are out of luck.
I just wanted to give you an example: I am a 27 year old girl, foreign-born and foreign-educated until I turned 16. My English is fairly good, but I still have problems that I am continuously working on day after day. When i took LSAT for the first time last year, I got a score of 152... A few months later I got a score of 154. One year later, on my laterst LSAT I received a 161. I definitely do not have money to spare and don't even start on my time :) (I work full-time, teach music part-time, and am in a professional band). My score became better because I had more time to learn English, and I was able to fit in more studying into my current schedule (no Kaplan, just a book). It helped me a lot! So I do think that reporting a higher score is a good idea. I do not believe an LSAT score may be a fluke, from what I heard/read LSAT is becoming harder each time, and since none of the questions really require any specific knowledge one might have about a certain topic, this just makes a possibility of a fluke tumble way down... Just my little input :) Thanks, Yana (Happy Holidays!!!)
Posted by Yana 22 Dec 2006, 15:16Hi Linda,
I appreciate your response, you certainly have more knowledge about this stuff than I do!
Still, doesn't the lack of disincentives for retaking influence (score-wise) test-takers who have tested at what they believe is representative of their capabilities to go ahead and take another shot in hopes of the higher score that that may not be representative? Couldn't that lead to less representative scores and isn't that an advantage for those with more time and money?
Also, I certainly think the lower scores will influence admissions decisions. Call me cynical, but it's the fact that the low scores can be completely disregarded and disguised during the admissions process should the school choose that I dislike.
Wouldn't a policy of taking the most recent LSAT score work better to mitigate both bad day scores and the incentive to retake in hopes of the high score?
I could certainly be off base here...
Posted by austingroothuis 03 Aug 2006, 17:21Austin,
Thanks for the oportunity to exchange views.
I also advise b-school applicants where the highest GMAT score has been used at virtually all schools for years. In the b-school world, the expense and sheer effort required to prepare for the GMAT and improve one's score means that applicants to do not continuously or flippantly take the GMAT. The "take it to the max" scenario you lay out above is a construct that reality doesn't bear out.
The overwhelming majority of b-school applicants have neither unlimited time nor unlimited money to take and retake the GMAT. And if they did, adcoms would take a dim view of this use of their resources.
Usually when applicants score below their target score two or at most three times, they simply accept the reality that their best score is going to be below their target.
Furthermore, b-school adcom members see the previous scores and they view it as "poor judgement" when applicants take the GMAT multiple times. I suspect law school adcoms would react similarly.
I advise law school applicants and b-school applicants to prepare for ONE test administration, and do everything possible to ensure that that one is a good day reflecting their abilities well. If things don't go according to plan, with the new policy, assming it becomes widespread, the person who does have a "bad day," fails to cancel when they should have, or simply takes the test without preparing adequately, can retake without the first score dragging down the latter score through averaging.
To me the widespread opportunity for a second crack at the LSAT unfettered by the first score outweighs by far the possibility that very few may abuse it.
Posted by Linda Abraham 03 Aug 2006, 16:49